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Abstract.  In  this  paper,  we  study  the  structure  of  optimal  solutions  to  the  sub- 
modular  function  minimization  problem.  We  introduce  prime  sets  and  pseudo¬ 
prime  sets  as  basic  building  block  of  minimizer  sets,  and  investigate  composition, 
decomposition,  recognition,  and  certification  of  prime  sets.  We  show  how  Schri- 
jver’s  submodular  function  minimization  algorithm  can  be  modified  to  construct 
in  polynomial  time  a  prime  or  pseudoprime  decomposition  of  the  ground  set.  We 
also  show  that  the  final  vector  x  obtained  by  this  algorithm  is  an  extreme  point 
of  the  polyhedron  P  :=  {x  £  R'  :  x  <  0;  x(A)  <  f(A )  for  all  A  CV}. 


1  Introduction 

The  problem  of  minimizing  a  submodular  function  has  been  known  to  be  polynomially 
solvable  since  1981,  when  Grotschel,  Lovasz,  and  Schrijver  [10]  showed  it  could  be  solved 
via  the  ellipsoid  method.  Until  1999,  a  purely  combinatorial  polynomial  algorithm  for  this 
problem  was  unknown.  In  1999,  Schrijver  [18]  and  independently  Iwata,  Fleischer,  and 
Fugishige  [14]  published  such  algorithms.  The  paper  by  McCormick  [16]  gives  an  excellent 
account  of  the  history  and  recent  developments  of  submodular  function  minimization. 

The  known  certificate  of  optimality  for  submodular  function  minimization  is  to  exibit  a  vector 
x,  say,  as  a  convex  combination  of  a  set  of  vectors  each  obtained  via  the  greedy  algorithm 
applied  using  some  chosen  ordering  of  the  ground  set.  A  set  U  is  shown  to  be  a  minimizer 
if  all  of  the  negative  and  none  of  the  positive  components  of  x  are  members  of  U,  and  U  is 
a  lower  ideal  in  each  of  the  chosen  orderings. 

This  convex  certificate  of  optimality  is  polynomially  verifiable,  since  the  collection  of  chosen 
orderings  can  be  taken  to  be  of  size  no  greater  than  the  ground  set.  Thus,  the  certificate  is 
verifiable  using  a  quadratic  number  of  function  calls  and  elementary  operations. 

The  motivation  for  the  present  work  was  to  find  a  different  certificate  of  optimality,  one 
that  doesn’t  involve  convex  combinations,  and  one,  hopefully,  that  could  be  verified  in  linear 
time. 

While  this  paper  doesn’t  succeed  in  this  goal,  it  does  provide  some  new  insights  about  the 
structure  of  optimal  solutions.  First,  we  introduce  two  slightly  different  basic  building  blocks 
for  minimizer  sets,  which  we  call  prime  sets  and  pseudo-prime  sets.  We  show  in  Theorem 
12  that  every  minimizer  set  decomposes  into  a  sequence  of  prime  sets,  each  of  which  adds 
nonnegative  marginal  value  (with  respect  to  its  predecessors  in  the  sequence),  and  we  also 
show  in  Theorem  19  it  decomposes  similarly  into  a  sequence  of  pseudo-prime  sets. 
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Next  we  go  on  to  investigate  further  prime  sets  and  pseudo-prime  sets,  with  the  goal  of 
finding  a  certificate  for  recognizing  them.  If  we  could  find  such  a  certificate,  then  this  would 
give  a  certificate  for  minimizers. 

The  motivating  idea  can  be  illustrated  on  a  2-element  example.  Consider  the  function  /  on 
ground  set  including  subset  {a,  b},  and  having  /({a})  =  1,  /({&})  =  1,  and  /({a,  6})  =  — 1. 
The  set  A  is  contained  in  every  minimizer  of  /.  A  is  an  example  of  both  a  prime  set  and 
a  pseudoprime  set.  This  example  can  be  extended  to  one  in  which  element  b  is  replaced  by 
a  subset  B  with  the  following  properties:  f(B)  =  1;  f(B  U  {a})  =  —1;  and  f(C  U  {a})  > 
/({a})  =  1,  for  every  proper  subset  C  C  B.  Again,  we  can  conclude  that  A  =  B  U  {a}  is 
contained  in  every  minimizer  of  /. 

The  previous  paragraph  illustrates  a  composition  of  ordered  prime  sets  in  both  cases:  In 
the  first  case,  {a},  with  positive  marginal  value  (with  respect  to  0),  and  {6},  with  negative 
marginal  value  (with  respect  to  {a})  compose  into  A,  which  itself  has  negative  marginal 
value;  in  the  second  case,  {a},  with  positive  marginal  value  and  Z?,  with  negative  marginal 
value  (with  respect  to  {a})  compose  into  A,  with  negative  marginal  value. 

We  show  in  Theorem  16  that  every  prime  set  with  negative  marginal  value  decomposes  into 
such  a  sequence  of  prime  sets,  where  the  first  member  has  positive  marginal  value  and  the 
rest  have  non-positive  marginal  value.  In  the  analog  for  pseudoprime  sets,  Theorem  20,  we 
have  that  every  pseudoprime  set  with  negative  marginal  value  decomposes  into  a  sequence 
of  exactly  2  pseudoprime  sets,  the  first  having  non-positive  marginal  value,  and  the  second 
having  non-negative  marginal  value  with  respect  to  the  first. 

These  2  theorems  give  some  hope  that  we  could  recognize  prime  sets  or  pseudoprime  sets. 
The  final  step  would  be  a  composition  theorem  that  gives  a  verifiable  list  of  conditions 
under  which  a  sequence  of  2  prime  (or  pseudoprime)  sets  composes  into  a  single  prime  (or 
pseudoprime)  set. 

To  that  end,  we  offer  Theorems  17  and  21.  Both  these  theorems  have  set  A  with  f(A)  < 
0  partitioned  into  a  sequence  {Ai,A2},  of  prime  (pseudoprime)  sets,  each  of  which  has 
nonnegative  marginal  value  with  respect  to  the  empty  set  and  non-positive  marginal  value 
with  respect  to  the  other.  In  each  case  we  can  conclude  that  A  is  contained  in  every  minimizer 
of  /,  but  we  cannot  conclude  that  A  is  prime  (pseudoprime). 

We  do  have  a  certificate  to  verify  that  a  set  A  is  pseudoprime.  Unfortunately,  this  certificate, 
stated  in  Theorem  25,  does  involve  forming  \A\  convex  combinations,  and  can  therefore  take 
0(|A|3)  function  calls  and  elementary  operations. 

The  remainder  of  the  paper  deals  with  the  algorithmic  question  of  hireling  a  pseudoprime 
decomposition.  We  show  that  Schrijver’s  algorithm  for  submodular  function  minimization 
can  be  extended  to  produce  such  a  decomposition.  We  also  show  that  when  it  finishes, 
the  components  of  the  decomposition  are  exactly  the  strongly  connected  components  of  the 
associated  auxiliary  digraph. 

Finally,  we  show  that  the  vector  x  produced  by  this  algorithm  provides  an  extreme  point 
optimal  solution  to  an  associated  linear  programming  problem. 
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2  Definitions 


In  this  section  we  present  necessary  definitions. 

Function  /  defined  on  subsets  of  finite  set  V  is  submodular  if.  for  every  pair  of  subsets  A  and 
B  of  V,  the  following  inequality  is  satisfied: 

f(A)  +  f(B)>f(AuB)  +  f(AnB).  (1) 

Equivalently,  for  every  pair  of  subsets  A  and  B  of  V,  with  A  C  B,  and  every  element  v  G  V, 
the  following  inequality  is  satisfied: 

f(A  +  v)~f(A)>f(B  +  v)-f(B),  (2) 

where,  here  and  throughout  this  paper,  the  expressions  Auju}  and  A—{v}  are  abbreviated 
by  A  +  v  and  A  —  v,  respectively,  for  A  C  V  and  v  G  V. 

Given  A  C  V  and  v  G  V  —  A,  the  marginal  value  of  v  with  respect  to  A,  denoted  m(v,  A),  is 
f(A  +  v)  —  f(A).  Thus,  condition  (2)  can  be  phrased  as  follows:  The  marginal  value  of  any 
element  is  non-increasing  on  any  sequence  of  sets  that  is  ordered  by  inclusion.  The  marginal 
value  of  subset  B  C  V  with  respect  to  A  is  m(B,A )  :=  f(A  U  B)  —  f(B).  The  marginal 
value  of  any  subset  is  similarly  non-increasing. 

The  submodular  function  minimization  problem,  is  to  find  S*  C  V  with  f(S*)  <  f(S),  for 
every  S  C  V.  Given  sets  S,A  C  V,  we  will  say  S  is  a  minimizer  for  f  on  A  if  S  C  A  and 
f(S)  <  f(B ),  for  every  B  C  A.  If  no  set  A  is  specified,  then  it  means  S  is  a  minimizer  for 
/  on  V. 

We  assume  throughout  that  /  is  normalized  (by  subtracting  /(0)  from  each  f(S),  if  neces¬ 
sary),  so  that  /(0)  =  0.  This  normalization  maintains  submodularity  and  does  not  affect 
the  optimal  solution  to  the  submodular  function  minimization  problem. 

Given  a  submodular  function  /  on  V,  and  given  S  C  V,  the  submodular  function  obtained 
by  contracting  S,  denoted  fv/s,  is  defined  as  follows: 

fv/s(P)  ■=  f(P  AS)-  f(S),  for  each  P  CV  -  S. 

Note  that  /vys(0)  =  0.  Let  my/s  denote  the  marginal  value  function  associated  with  fv/s- 
Assume  { A ,  B,  C,  D}  is  a  partition  of  V,  and  Then,  directly  from  definitions,  we  have: 

mv/A(C,  B)  =  fv/A(C  U  B)  -  fv/A(B) 

=  f(CUBuA)-f(A)-f(BuA)  +  f(A) 

=  m(C,  B  U  A).  (3) 

Let  -<  be  a  total  order  of  V.  For  v  G  V,  the  closed  lower  ideal  defined  by  v,  denoted  [w] ^ , 
is  the  set  {u  G  V  :  u  ^  v},  and  the  open  lower  ideal  defined  by  v,  denoted  [v)^,  is  the  set 
{u  G  V  :  u  -<  u}. 

Suppose  V  is  partitioned  into  a  sequence  of  sets: 

S1,S2,...,Sk,T1,T2,...,Tr,  (4) 
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and  we  have  a  total  order  -<  on  Id.  Then  -<  is  compatible  with  the  sequence  (4)  if  for  every 
u,  v  G  V,  if  u  G  Si  and  v  G  Si+ 1  U  ■  •  ■  U  Tn  then  n-<n;  and  if  u  G  T*  and  v  G  7j+ 1  U  •  •  •  U  Tr, 
then  u^v.  Define 

:=S1U...USfcUT1U...UTj_1. 

When  no  total  order  -<  is  specified,  we  will  omit  the  superscript  and  just  write  [5*)  or  [T*). 

2.1  Functions  /  and  / 

Assume  function  /  on  subsets  of  V  is  submodular  and  /(0)  =  0.  Define  function  /  on  subsets 
A  of  V  as  follows: 

f(A)  :=f(V~A)-f(V). 

It  is  straightforward  to  see  that  /  is  submodular  and  / (0)  =  0.  Moreover, 

S*  is  a  minimizer  of  /  on  V  Id  S'*  is  a  minimizer  of  /  on  Id  (5) 

Let  m,  denote  the  marginal  value  function  defined  by  /.  That  is,  for  each  B  G  V  and 
ACV  -B, 

m(B,A):=/(AUB)-f(A). 

The  following  relationships  follow  directly  from  the  definitions: 

Let  {B,  C ,  D}  be  a  partition  of  V. 

m(C,B)  =  f(B  +  C)-f(B ) 

=  f(D)  +  f(V)-f(C  +  D)-f(V) 

=  —m(C,  D)  (6) 

Let  {A,  5,  C,  D,  E}  be  a  partition  of  Id. 

mv/A(C,B)  =  f(BUCuA)  —  f  (A)  -/(BUA)  +  / (A) 

=  f(DUE)  +  f(V)-f(CUDUE)  +  f(V) 

=  f(DUE)-f(CUDUE) 

=  f{D\JE)-f(E)-f(C\JD\JE)+f(E) 

=  — fhv/E(C,D )  (7) 

2.2  Prime  sets 

Given  a  normalized  submodular  function  /  on  finite  set  Id,  a  subset  0  ^  A  C  Id  is  called 

prime,  with  respect  to  /,  if  /(5)  >  0  and  m(B,  A  —  B)  <  0,  for  every  0  ^  B  C  A. 

Lemma  1  Let  {G,  A,D}  6e  a  partition  of  V  in  which  A  ^  0.  A  is  prime  with  respect  to 
fv/c  If  and  only  If  A  is  prime  with  respect  to  fv/o- 

Proof  Let  0  ^  B  C  A.  By  (7),  we  have  that 

fv/c(B)  =  mv/c(B,  0) 

=  — fhv/D(B,A  —  B ),  (8) 
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and 


mv/C(B,  A  —  B)  =  —mv/D(B,  0) 

=  ~Iv/d(B).  (9) 


Therefore, 


fv/c{B )  >  0  itiv/d(B ,  A  —  B)  <  0, 


and 

™>v/c{B,  A  —  B)  <  0  fv/D(B)  >  0. 


Together,  these  give  A  is  prime  with  respect  to  fv/c  if  and  only  if  A  is  prime  with  respect 
t°  fv/D,  as  desired.  □ 


Lemma  2  Let  {C,  A,D}  be  a  'partition  of  V  in  which  d  /  0.  If  fv/c(A)  <  0,  then  A  is 
prime  with  respect  to  fv/c  if  and  only  if  fv/c  (B)  >  0,  for  every  0  fz  B  C  A.  If  fv/c  (A)  >  0, 
then  A  is  prime  with  respect  to  fv/c  if  and  only  if  mv/c{B ,  A  —  B )  <  0,  for  every  0  ^  B  C  A. 


Proof  We  prove  the  first  statement.  The  second  follows  from  the  first,  using  Lemma  1  and 
the  relationship  between  /  and  /.  The  “only  if”  direction  follows  immediately  from  the 
definition  of  prime.  For  the  “if”  direction,  let  0  ^  B  C  A.  Then: 

mV/c(B,A-B)  =  fV/c(A)-fv/c(A-B)  (10) 

<  0,  (11) 

where  (10)  follows  from  the  definition  of  marginal  value,  and  (11)  follows  since  fv/c{A)  <  0 
and  fv/c{A  —  B)  >  0.  □ 

Lemma  3  Let  {C,  A,  D}  be  a  partition  of  V  in  which  A  ^  $  is  prime  with  respect  to  fv/c, 
and  fv/c  {A)  <  0  .If  f(A)  <  0,  then  A  is  prime  with  respect  to  f . 

Proof  By  Lemma  6,  it  suffices  to  show  that  f(B)  >  0,  for  each  0  ^  B  C  A.  Let  0  ^  B  C  A. 
Then 


f(B)  =  m(B,  0) 

>  m(B,  C) 

>  0, 


(12) 

(13) 

(14) 


where  (12)  follows  by  definition  of  marginal  value  and  the  fact  that  /(0)  =  0;  (13)  follows 
by  submodularity;  and  (14)  follows  from  the  fact  that  A  is  prime  with  respect  to  fv/c-  1=1 


3  Self  Minimizers 

A  subset  S  C  V  is  a  self  minimizer  of  /  if  f(S)  <  f(A),  for  every  A  C  S.  Clearly,  0 
is  a  self  minimizer,  and  any  minimizer  of  /  on  V  is  a  self  minimizer.  Set  A  is  a  minimal 
self  minimizer  of  f  if  A  ^  0,  A  is  a  self  minimizer  of  /,  and  A  contains  no  proper  subset 
satisfying  these  two  properties. 


5 


3.1  Characterizations  of  self  minimizers  and  minimal  self  mini- 
mizers 

Lemma  4  Let  Then  A  is  a  self  minimizer  of  f  if  and  only  if  m(B,  A  —  B)  <0, 

for  each  0  ^  B  C  A. 

Proof.  For  any  0  ^  B  C  A, 

m(B,  A  —  B)  =  /(A)  —  f  (A  —  B). 

Therefore,  m(B,  A  —  B)  <  0  for  all  such  B,  if  and  only  if  /(A)  <  /(A  —  B ),  for  all  such  B, 
which  is  the  definition  of  A  being  a  self  minimizer.  □ 

Lemma  5  Let  0  /  B  C  f,  If  f(B)  <  0,  then  B  contains  a  nonempty  self  minimizer. 
In  particular,  any  S  C  B  that  is  minimal  with  respect  to  both  being  nonempty  and  having 
f(S)  <  0  is  a  minimal  self  minimizer. 

Proof.  Take  S  to  be  a  minimal  nonempty  subset  of  B  having  f(S)  <  0.  Then  since 
f(S')  >  0  >  /(S'),  for  every  0  ^  S'  C  S,  we  have  that  S'  is  a  minimizer  of  /  on  S',  as  desired. 
□ 

Lemma  6  Let  0  7^  A  C  V.  Then  A  is  a  a  minimal  self  minimizer  of  f  if  and  only  if  the 
following  conditions  hold: 

1.  /(A)  <  0. 

2.  f{B)  >  0,  for  every  0  7^  B  C  A. 

Proof.  (<*=)  Let  0  7^  B  C  A.  By  item  2,  /(0)  =  0  <  f(B),  and  by  item  1,  f(A)  <  f(0). 
Combining,  we  have  A  is  a  self  minimizer  of  /  and  B  is  not  a  self  minimizer  of  /.  Therefore, 
A  is  a  minimal  self  minimizer  of  /. 

(=4>)  Assume  A  is  a  a  minimal  nonempty  self  minimizer  of  /  and  let  0  7^  B  C  A.  If  f(B)  <  0, 
then  by  Lemma  5,  B  contains  a  nonempty  self  minimizer,  a  contradiction.  Therefore,  item 
2  must  hold.  Now,  since  A  is  a  self  minimizer,  /(A)  <  /(0)  =  0  item  1  holds,  as  desired.  □ 

Lemma  7  Let  {C,  A,  D}  be  a  partition  ofV  in  which  A  /  0.  A  is  a  minimial  self  minimizer 
of  fv/c  and  only  if  A  is  prime  with  respect  to  fv/c,  and  fv/c{A )  <  0. 

Proof  (=>)  Assume  A  is  a  minimal  self  minimizer,  and  let  0  7^  B  C  A.  By  Lemma  6, 
fv/c  {A)  <  0,  fy/c(B)  >  0,  and  fy/c{A  —  B)  >  0.  It  follows  that 


mv/c(B ,  A  -  B)  =  fv/c  (A)  -  fv/c{A  -  B)  <  0, 


as  desired. 

(<^=)  Assume  A  is  prime  and  fv/c  (A)  <  0.  By  definition  of  prime,  fv/c(B)  >  0,  for  each 
0  /  B  C  A.  Now  by  Lemma  6,  A  is  a  minimal  self  minimizer,  as  desired.  □ 
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Lemma  8  Let  {C\  A,  D }  be  a  partition  of  V  in  which  A  ^  0.  A  is  a  minimial  self  minimizer 
°f  fv/D  and  only  if  A  is  prime  with  respect  to  fy/c,  and  fv/c(A )  >  0. 

Proof  This  follows  immediately  from  Lemmas  1  and  8,  using  the  fact  that 

fv/c{A )  >  0  <£=>  fy/D(A)  <  0. 


□ 

3.2  Decomposition  of  minimizers  into  minimal  self  minimizers 

Lemma  9  Assume  A  C  V  is  a  self  minimizer  of  f ,  and  C  C  A.  Then  A  —  C  is  a  self 
minimizer  of  fy/c  ■ 

Proof.  Let  0  ^  B  C  A  —  C.  Then 


my/c(B,A  —  C  —  B)  =  m(B,A  —  B )  (15) 

<  0,  (16) 

where  (15)  follows  from  (3),  and  (16)  follows  from  Lemma  4  and  the  fact  that  A  is  a  self 
minimizer  of  /.  Now,  again  by  Lemma  4,  A  —  C  is  a  self  minimizer  of  fy/c,  as  desired.  □ 

Lemma  10  Assume  A  C  V .  If  A  is  a  self  minimizer  of  f ,  then  A  is  contained  in  some 
minimizer  of  f . 

Proof.  Let  T  be  a  minimizer  of  /.  We  have: 

f(A  U  T)  <  f(A)  +  f{T)  -  f(A  n  T)<  f(T), 

where  the  first  inequality  holds  because  /  is  submodular,  and  the  second  inequality  holds 
because  A  is  a  self  minimizer  of  /.  □ 

Lemma  11  Assume  B  C  S  C  V ,  that  B  is  a  self  minimizer  of  f ,  and  that  S  —  B  is  a  self 
minimizer  of  fN/B  ■  Then  S  is  a  self  minimizer  of  f . 

Proof.  Let  S'  C  S.  Then 


f(S')  >  f(B  U  S')  +  /(S'  HB)~  f(B) 

(17) 

=  f(S'nB)  +  fN/B(S'-B) 

(18) 

>  f(B)  +  fN/B(S-B) 

(19) 

=  m, 

(20) 

where  17  follows  by  submodularity  of  /,  18  follows  by  definition  of  contraction,  19  follows 
because  B  is  a  self  minimizer  of  /  and  S  —  B  is  a  self  minimizer  of  .In/b,  arid  20  follows  by 
the  definition  of  contraction.  Thus,  S'  is  a  self  minimizer  of  /,  as  desired.  □ 
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Theorem  12  Assume  S  is  a  minimizer  of  f .  Then  S  may  be  partitioned  into  a  sequence 
of  non-empty  subsets  Si,  S2,  •  •  • ,  Sk,  such  that  for  each  i  G  { 1,2,...,  k},  we  have  that  Si  is  a 
minimal  self  minimizer  of  fv/[Si)- 

Proof.  The  proof  is  by  induction  on  |»S'| .  The  theorem  is  certainly  true  if  \S\  =  0.  Assume 
\S\  >  0  and  that  the  theorem  is  true  for  all  normalized  submodular  functions  and  minimizers 
with  fewer  elements.  Since  S'  is  a  minimizer  of  /,  we  know  that  S'  is  a  self  minimizer  of  /. 
Therefore,  S'  contains  a  minimal  nonempty  self  minimizer,  Si,  say,  of  /.  By  Lemma  9,  S'  — Si 
is  a  self  minimizer  of  fy/sx  ■  By  the  induction  hypothesis,  S  —  S\  may  be  partitioned  into  a 
sequence  of  non-empty  subsets  S'2, . . . ,  Sk,  such  that  for  each  i  G  {2, . . . ,  k},  we  have  that  S'* 
is  a  minimal  nonempty  self  minimizer  of  fv/is,]  ■  This  completes  the  proof.  □ 

Corollary  13  Let  f  be  a  submodular  function  on  V.  Then  there  is  a  partition  of  V  into  a 
sequence  Si,  S'2, . . . ,  Sk,  Ti,  T2, . . . ,  Ti,  such  that 

•  m(Si,  [Si))  <  0  and  Si  is  prime  with  respect  to  fv/[Si),  for  eac/i  i  G  1, . . . ,  k;  and 

•  m(Ti ,  [Tf)  >  0  and  T  is  prime  with  respect  to  fv/[Ti),  for  each  i  G  1, . . . ,  l. 

Proof.  This  follows  directly  from  Theorem  12,  together  with  (5)  and  Lemma  8.  □ 

Theorem  14  Let  Si,  S2, . . . ,  Sk  be  a  sequence  of  disjoint  nonempty  subsets  of  V  such  that 
for  each  i  e  {1,2,...,  k},  we  have  that  S)  is  a  self  minimizer  of  fv/[Si)-  Then  S  :=  S'iU-  •  -US'*, 
is  a  self  minimizer  of  f .  Moreover,  if  Si,  S2,  ■  ■  . ,  Sk  is  a  maximal  such  sequence,  then  S  is  a 
minimizer  of  f . 

Proof.  We  begin  with  the  proof  that  S'  is  a  self  minimizer  of  /.  The  proof  is  by  induction 
on  k.  If  k  =  1,  then  the  result  is  immediate.  Assume  true  for  all  smaller  k.  Then,  by  the 
induction  hypotheses,  we  can  conclude  that  Si  U  •  •  •  U  Sk~i  is  a  self  minimizer  of  /.  By 
Lemma  11,  S  is  a  self  minimizer  of  /. 

Now  assume  Si,  S2, ... ,  Sk  is  a  maximal  such  sequence;  that  is,  fy/s  has  no  nonempty  self 
minimizer.  Since  S'  is  a  self  minimizer  of  /,  we  have  by  Lemma  10  that  S'  is  contained  in 
some  minimizer  S*  of  /.  If  S  ^  S*,  then  by  Lemma  9,  S*  —  S  is  a  nonempty  self  minimizer 
of  fv/s,  a  contradiction.  Thus,  S  =  S*,  as  desired.  □ 

Lemma  15  Let  {C,A,D}  be  a  partition  of  V  in  which  A  ^  0,-  A  is  prime  with  respect  to 
fv/cl  and  fv/c(A )  <  0.  If  f(A)  >  0,  then  there  is  a  partition  of  A  into  a  sequence  Ai, . . . ,  Ak, 
such  that,  for  each  i  G  {!,....  k},  At  is  prime  with  respect  to  fv/[Ai),  and  fv/[Ai)(Ai)  >  0. 

Proof.  From  Theorem  12,  it  suffices  to  show  that  A  is  a  minimizer  with  respect  to  fv/cuD- 
To  show  this,  it  suffices  to  show  that  fhv/cuD^B ,  A  —  B)  =  f(B)  >  0,  for  every  0  7^  B  C  A. 

f(B)  =  m(B,  0)  (21) 

>  m{B,  C)  (22) 

>  0,  (23) 

where  (21)  follows  by  definition;  (22)  follows  by  submodularity;  and  (23)  follows  because  A 
is  prime  with  respect  to  fy/c  1=1 
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Minimal  self  minimizers 


4.1  Decomposition  of  minimal  self  minimizers 

The  goal  is  to  efficiently  recognize  minimal  self  minimizers.  Toward  this  goal,  we  have  a 
decomposition  result. 

Theorem  16  Let  A  be  a  minimal  self  minimizer  of  f  with  |A|  >1.  Then  there  is  a  partition 
of  A  into  a  sequence  of  at  least  two  nonempty  sets  {Ax,  •  •  • ,  Ak},  such  that  the  following  hold: 

1.  Each  Ai  is  prime  with  respect  to  fv/[Ai),  for  each  i  e  {1, . . . ,  k}; 

2.  f(A 0  >  0; 

3.  m(Ak,  [Ak))  <  0; 

4-  m(Aii  [4j))  =  0,  for  each  i  e  { 2, —  1}; 

5.  if  k  >  2,  then  m(Ak,  [A))  >  0,  for  each  i  e  {1, . . . ,  k  —  1}. 

Proof.  Let  A\  be  a  nonempty  proper  subset  of  A  with  smallest  value  of  /,  among  nonempty 
proper  subsets  of  A,  and  subject  to  this,  choose  A\  to  be  minimal.  Recursively,  starting  with 
i  —  2,  as  long  as  A  —  { A f)  ^  0,  define  A ,  to  be  a  minimal  self  minimizer  of  fv/[A,)-  Each  Ai 
exists,  since  m(A  —  [Af),  [A*))  <  0. 

By  choice  of  Ai,  we  have  that  both  Ai  and  A  —  Ai  are  nonempty.  Then,  since  A  is  a  minimal 
self  minimizer,  and  is  therefore  prime,  we  know  that  f(Ai)  >  0  and  fv/[Ak) (Ak)  <  0.  The 
fact  that  m(Ai,  [A*))  <  0,  for  each  i  e  {2, . . . ,  k  —  1},  follows  from  the  fact  that  each  At  to 
be  a  minimal  self  minimizer  of  fv/[Ai)-  If  w(4j,  [A))  <  0,  for  some  i,  then  this  contradicts 
the  choice  of  A\. 

Finally,  assume  k  >  2,  and  let  i  e  {1, . . . ,  k  —  1}.  If  i  =  1,  then  m(Ak,  0)  >  0  follows  because 
A  is  a  minimal  self  minimizer.  Assume  i  e  {2, . . . ,  k  —  1}.  Supppose  m{Ak ,  [A))  <  0.  Then 

f{AkU[Ai))  =  f([Ai))+m(Ak,[Ai)) 

—  f(A i)  +  m(Ak,  [Aj)) 

<  f(Ai), 


contradicting  choice  of  A\.  □ 

4.2  Composition  of  minimal  self  minimizers 

We  seek  a  composition  theorem  for  minimal  self  minimizers.  Particularly  nice  would  be  a 
theorem  analagous  to  the  decomposition  Theorem  16.  Such  a  result  would  lead  directly  to 
a  recognition  algorithm,  since  each  item  in  that  theorem  can  be  efficiently  verified. 

We  do  not  have  such  a  result,  but  we  have  some  observations  in  that  direction. 

Throughout  this  section,  let  us  assume  the  following.  We  have  a  subset  0  ^  A  C  V,  such 
that  f(A)  <  0,  and  a  partition  of  A  into  a  sequence  A±, . . . ,  Ap  of  p  >  2  nonempty  sets. 
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The  goal  is  to  find  conditions  under  which  we  can  conclude  A  is  a  minimal  self  minimizer. 
Equivalently,  by  Lemma  6,  we  need  to  show  f(B)  >  0,  for  each  0  7^  B  C  A. 

Let  0  7^  B  C  A.  Define  Bi  :=  B  D  At,  and  let  C*  :=  C  D  Ai}  for  each  i  e  {1 . . .  p}. 

The  following  theorem  is  the  best  we  do  in  this  paper,  with  the  conclusion  that  A  is  a 
self  minimizer  (not  necessarily  minimal).  This  theorem  also  states  that  f(B)  >  0  for  some 
subsets  B  of  A,  and  that  if  f(B)  <  0,  then  B  must  contain  Ap. 

Theorem  17  Assume  0  7^  A  C  V ,  such  that  f(A)  <  0,  and  a  partition  of  A  into  a  sequence 
A1, ...  ,Ap  of  p  >  2  nonempty  sets,  with  the  properties: 

1.  Ai  is  prime  with  respect  to  fv/[Ai),  for  each  i  e  {1 . .  .p}; 

2.  f(Af)  >  0  for  each  i  G  {1, . .  .,p}; 

3.  m(Ai,Ap)  <  0,  and  m(Ap,  [Ap))  <  0; 

4.  m(Ah  [A))  =  0,  for  each  i  G  {2, . . .  ,p  -  1}; 

Then  A  is  a  self  minimizer  with  respect  to  f . 

Let  0  7^  B  C  A.  If  Ap  —  B  7^  0,  then  f(B)  >  0.  In  addition,  there  is  a  set  A'Cl  such  that 
Ap  C  A',  and  A'  is  a  minimal  self  minimizer  with  respect  to  f .  Moreover,  every  minimal 
self  minimizer  with  respect  to  f  contained  in  A  properly  contains  Ap. 

Proof.  We  leave  the  fact  that  A  is  a  self  minimizer  for  last. 

Let  0  7^  B  C  A,  with  Ap  —  B  =  Cp  7^  0.  Then  we  have  that  m(Bp,  [4,-1))  >  0.  Now, 


f(B)  =  E  miB^B.U- 

•  •  u  A-0 

(24) 

*e{i,...,p} 

>  E  rn(Bi,Ai\J-- 

■  •  u  4-0 

(25) 

*e{  i,...,p} 

>  0, 

(26) 

where  (24)  follows  by  definition  of  marginal  value;  (25)  follows  by  submodularity; 

and  (26) 

follows  by  the  facts  that  At  is  prime  with  respect  to  fv/[Ai_ p,  m(Ai,  [A^))  >  0,  for  i  e 
{1, . . .  ,p  -  1},  and  m(Bp,  [Ap_i))  >  0. 

Now,  to  argue  f(B)  >  0,  we  need  to  show  that  at  least  one  term  in  (24)  is  strictly  positive. 
If  B 1  7^  05  then  the  first  term  is  positive.  Suppose  Bi  =  0.  Let  2  <  q  <  p  be  the  smallest 
index  with  Bq  7^  0.  Then  the  first  nonempty  term  in  (24)  is  m(Bq,(h).  If  Bq  7^  Aq,  then  this 
term  is  positive,  since  Ap  is  prime.  If  Bq  =  Aq,  then  this  term  is  positive,  by  item  2. 

Next  we  investigate  A'.  Since  f(A)  <  0,  A  contains  a  minimal  self  minimizer,  A' .  Since 
f(B)  >  0,  for  every  nonempty  subset  that  doesn’t  contain  Ap,  it  must  be  that  Ap  C  A'. 
Since  f(Ap)  >  0,  Ap  7^  A'. 

Finally,  we  show  A  is  a  minimizer  by  showing  m(A  —  B,B)  <  0,  for  each  BOA.  If 
Ap  —  B  7^  0,  this  follows  easily: 

m(A-B,B)  =  f(A)-f(B)<0, 
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(27) 


T  since  f(A)  <  0  and  f(B)  >  0.  Now  assume  Ap  C  B.  Then: 

m(A  —  B,B )  =  m(Ci,  B)  +  m(Ci,  B  U  [A^)) 

<  m(Ci,Bi  UAP)  +  m(Ci,  Bi  (J  [Ai))  (28) 

<  0,  (29) 

where  (27)  follows  by  definition  of  marginal  value,  and  (28)  follows  by  submodularity.  For 
(29),  we  show  each  term  of  (28)  is  nonnegative.  The  first  term  follows,  if  C\  ^  Ai,  since  A\ 
is  prime.  If  C\  =  A\,  then  it  follows  from  item  3.  That  each  term  in  the  sum  of  the  second 
term  of  (28)  is  nonnegative  follows  by  item  1,  if  Ci  ^  Ai,  and  by  item  4,  otherwise.  □ 

We  would  need  at  least  one  more  (as  yet  unknown)  condition,  besides  those  in  Theorem  17, 
to  prove  A  is  a  minimal  self  minimizer.  Indeed,  here  is  an  example  where  A  =  A\  U  A2  is 
not  a  minimal  self  minimizer,  although  A,  A±,  and  A2  satisfy  the  conditions  of  Theorem  17. 
In  the  example  below,  Ax  =  {a,  b},  A2  =  {c}. 

The  needed  condition  must  rule  out  subsets  B  with  Ak  C  B  C  A  and  f(B)  <  0. 


Clearly  A  is  not  a  minimal  self  minimizer,  since  /({&,  c})  <  0.  A  is,  however,  a  self  minimizer. 

In  the  special  case  where  p  =  2  and  IT^I  =  1,  we  can  prove  a  composition  theorem. 

Theorem  18  Assume  a  partition  {E,A,D}  of  V ,  such  that  0  7^  A  C  V.  Assume  also  that 
u  G  A,  and  A\  =  A  —  u,  with  the  property  that  A\  is  prime  with  respect  to  fv/(E+u)-  Assume 
also  the  following  conditions: 

1-  fv/E(A )  <  0; 

2-  fv/E(u)  >  0; 

3 ■  fv/E(A\)  >  0; 

Then  A  is  prime  with  respect  to  fv/E- 

Proof.  By  item  1  and  Lemma  6,  we  need  only  to  show  f(B)  >  0,  for  each  0  7^  B  C  A.  To 
that  end,  let  0  7^  B  C  A. 

If  B  —  {«},  then  f(B)  >  0,  by  item  2.  If  B  —  Ai,  then  f(B)  >  0,  by  item  3.  If  u  G  B,  then 

f(B)  =  f  (u)  +  mv/E (B  r  Ai,u)  (30) 

>  0,  (31) 
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where  (30)  follows  by  definition  of  marginal  value;  and  (31)  follows  by  item  2  and  the  fact 
that  Ai  is  prime  with  respect  to  fv/(E+u)- 

Otherwise,  B  C  A,  and: 


f(B)  =  mv/E(BnA1,0)  (32) 

>  rnv/E(B  n  Ai,u)  (33) 

>  0,  (34) 

where  (32)  follows  by  definition  of  marginal  value;  (33)  follows  by  submodularity.  (34)  follows 
by  item  2  and  the  fact  that  A±  is  prime  with  respect  to  fv/(E+u)-  1=1 

Lest  one  might  believe  a  similar  theorem  holds  in  the  case  that  item  1  is  replaced  with 
fv/E(A)  >  0,  we  have  this  counterexample  shown  in  the  table  below,  where  V  =  {a,b,c}. 

It  is  straightforward  to  check  that  letting  A  =  {a,b,c}  and  A1  =  {b,  c},  we  have  that  Ai  is 
prime  with  respect  to  fv/a]  /(a)  >  0;  f(Ai)  >  0;  and  f(A)  >  0.  However,  A  is  not  prime 
with  respect  to  /.  Indeed,  m({a,  b},  c )  >  0. 


B 

f{B) 

m(a,B) 

m(b,B) 

m(c,B ) 

m(B,a) 

m(B,b) 

m(B,c) 

{a} 

1 

2 

2 

0 

0 

m 

1 

2 

2 

0 

0 

M 

1 

2 

2 

0 

0 

{a,  6} 

3 

-1 

2 

{b,c} 

3 

-1 

2 

{a,c} 

3 

-1 

2 

{a,b,  c} 

2 

□ 


Another  possible  analog  would  be  the  following  conditions: 

1.  A1  prime  with  respect  to  fv/(E+u )! 

2-  fv/E(A )  >  0; 

3.  mv/E(Ai,  u)  <  0; 

4.  mv/E(u,Ai)  <  0; 

But  again,  these  don’t  imply  A  is  prime  with  respect  fv/E,  as  the  following  example  shows: 


In  this  example,  A  =  V  =  {a,b,c}.  Let  u  =  a,  and  Ax  =  {b,  c}.  It  is  straightforward  to 
check  that  A\  is  prime  with  respect  to  fv/a  and  the  conjectured  conditions  hold.  But  since 
m(a,  {b,  c})  >  0,  the  set  A  cannot  be  prime.  □ 
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Another  possible  conjecture  is  that  every  prime  set  decomposes  as  in  Theorem  18.  Unfortu¬ 
nately  this  is  not  true.  Below  is  an  example  of  a  minimal  self  minimizer  A  such  that  A  —  u 
is  not  a  minimal  self  minimizer  with  respect  to  fv/u,  for  every  u  €  V. 


5  Pseudoprime  Sets 

In  Sections  4.1  and  4.2,  it  becomes  evident  that  sets  with  zero  marginal  value  add  compli¬ 
cation.  For  this  reason,  we  introduce  the  notion  of  pseudoprime  sets.  A  psuedoprime  set  A 
is  a  prime  set  unless  it  has  a  nonempty  proper  subset  with  function  value  equal  to  0  or  to 
that  of  set  A  itself. 

In  this  section,  we  define  pseudoprime  sets  and  list  the  properties  and  results  that  are 
analogous  to  those  for  prime  sets.  In  each  case,  the  proof  is  similar  but  simpler  to  its 
prime-set  analog.  Therefore,  we  omit  these  proofs. 

Given  a  normalized  submodular  function  /  on  V,  a  set  A  C  U  is  pseudoprime  if  for  each 
0  /  B  C  4,  the  following  two  properties  hold: 

•  f(B )  >  0,  and 

•  m(B ,  A  —  B)  <  0. 


Pseudoprime  sets  have  many  of  the  same  properties  as  prime  sets,  and  we  list  several  here 
without  proof.  For  this  purpose,  assume  V  is  partitioned  into  a  sequence  {C,  A,  D}. 

•  A  is  pseudoprime  with  respect  to  fv/c  if  and  only  if  A  is  pseudoprime  with  respect  to 
fv/D- 

•  If  fv/c  (A)  <  0,  then  A  is  pseudoprime  with  respect  to  fv/c  if  and  only  if  fv/c{B )  >  0, 
for  every  0  7^  B  C  A. 

•  If  fv/c  (A)  >  0,  then  A  is  pseudoprime  with  respect  to  fv/c  if  and  only  if  mv/c{B ,  A  — 
B )  <  0,  for  every  0^Bc4. 

•  Assume  A  is  pseudoprime  with  respect  to  fv/c,  and  fv/c  (A)  A  0.  If  f(A)  <  0,  then  A 
is  pseudoprime  with  respect  to  /. 

The  connection  between  pseudoprime  sets  and  minimal  self  minimizers  is  not  very  natu¬ 
ral.  However,  we  do  have  the  following  decomposition  of  minimizers  into  pseudoprime  self 
minimizers. 
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•  If  A  is  pseudoprime  with  respect  to  fv/c  and  fv/c  (A)  <  0,  then  A  is  a  self  minimizer 
with  respect  to  fv/c- 

•  If  A  is  pseudoprime  and  fv/c{j 4)  >  0,  then  A  is  a  self  minimizer  with  respect  to  fv/c- 

•  If  A  is  a  self  minimizer  with  respect  to  /,  then  A  can  be  partitioned  into  a  sequence 
{A1,A2, . . . ,  Afc},  such  that  for  each  i  e  {1, . . . ,  k},  Ai  is  pseudoprime  with  respect  to 
fv/[Ai)  and  fv/[Ai){Ai)  <  0. 

•  If  A  is  partitioned  into  a  sequence  {Ai,  A2, . . . ,  A*,},  such  that  for  each  i  e  {1, . . . ,  k}, 
Ai  is  pseudoprime  with  respect  to  fv/[A,)  and  fv/[A,)(At)  <  0,  then  A  is  a  self  minimizer 
with  respect  to  /. 

Theorem  19  There  is  a  partition  of  V  into  a  sequence  of  sets 

{ S\ ,  S2 , ,  Sk ,  T\ ,  T2 , . . . ,  TJ } , 


such  that 

•  fv/[st) (S%)  <  0,  and  Si  is  pseudoprime  with  respect  to  fv/[Si),  for  each  i  G  {1, . . . ,  k}; 

•  fv/[Ti)(Ti)  >  0,  and  Ti  is  pseudoprime  with  respect  to  fv/[Ti),  for  each  i  G  {1, . . . , 

Given  such  a  partition,  the  set  S  Si  U  S2  U  •  •  •  U  is  a  minimizer  of  f .  Moreover,  every 
minimizer  of  f  decomposes  in  this  way. 

□ 

A  sequence  of  the  type  ensured  by  Theorem  19  is  called  a  pseudoprime  decomposition  of  V. 
The  decomposition  theorem  for  pseudoprime  sets  that  is  analagous  to  Theorem  16  is  simpler: 

Theorem  20  Let  A  he  a  pseudoprime  set  with  respect  to  f.  Then  there  is  a  partition  of  A 
into  a  sequence  of  two  nonempty  sets  {Ai,A2},  such  that  the  following  hold: 

•  A\  is  pseudoprime  with  respect  to  f  and  A2  is  pseudoprime  with  respect  to  fv/AG 
f(A i)  >  0  and  m{A2 ,  Af)  <  0; 

•  f(A2)  >  0  and  m{A1,A2)  <  0; 

As  for  composition,  as  in  the  case  of  primes,  the  conditions  under  which  a  partition  of  A  into 
sequence  {Ai,  A2}  satisfying  the  above  three  properties  implies  A  is  pseudoprime  remain  an 
open  question.  We  do,  however,  have  an  analog  to  Theorem  17. 

Theorem  21  Assume  0  ^  A  C  V,  such  that  f{A)  <  0,  and  a  partition  of  A  into  a  sequence 
of  nonempty  sets  {Ai,A2},  with  the  properties: 

1.  Ai  is  pseudoprime  with  respect  to  f  and  A2  is  pseudoprime  with  respect  to  fv/AG 

2.  f(Ai)  >  0  and  m(A2,  Af)  <  0; 
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3.  f{A2)  >  0  and  m(Ai,  A2)  <  0; 

T/mn  A  is  a  self  minimizer  with  respect  to  f . 

We  do  give  a  polynomial  certificate  for  verifying  a  set  A  is  a  pseudo-prime  set  in  Theorem 
25.  Unfortunately,  this  is  a  convex  certificate  involving  not  just  one  but  |7L|  vectors. 

Let  0  B  C  A.  If  A2  —  B  0,  then  f(B)  >  0  .In  addition,  if  f(A)  <  0,  then  there  is  a  set 
A'  C  A  such  that  A2  C  A' ,  f(A')  <  0,  and  A'  is  pseudoprime  with  respect  to  f .  Moreover, 
every  such  subset  A1  of  A  properly  contains  A2 . 


6  Polyhedral  and  Algorithmic  Issues 

Given  a  submodular  funcion  /  on  V,  with  /(0)  =  0,  Edmonds  [4]  defined  the  polyhedron: 
Pf  :=  {iGR1  :  x{V)  =  f(V );  x(A )  <  f(A),  for  every  A  C  V}, 

where  R'  denotes  the  |F  (-dimensional  real  vector  space  with  components  indexed  on  V,  and 
for  x  G  R'  and  A  C  V,  x(A)  :=  Y1vgaxv  Given  a  total  order  -<  of  the  set  V,  the  greedy 
vector  b ^  is  defined  as  follows: 


K  ■=  /( H^)  -  /([wH- 

IIere  are  2  definitions  equivalent  to  the  one  above: 

bj;  :=  m(v,  (35) 

K  ■=  fv/[v)^{v).  (36) 

Theorem  22  (Edmonds  [4])  The  extreme  points  of  Pf  are  exactly  the  greedy  vectors  IP  . 

□ 

Given  a  partition  of  V  into  a  sequence  {E,A,D}  of  subsets,  define  fv/E\D  to  be  the  sub- 
modular  function  on  A,  where  for  B  C  A, 

fv/E\D(B )  :=f{BUE)-f{E). 

Given  vectors  x  G  WE  and  y  G  R  v,  let  x\y  G  R'fcu'4  be  the  concatination  of  x  and  y. 
Proposition  23  Let  {E,  A}  be  a  partition  of  V ,  x  G  Py\A,  and  y  G  Pfv/E ■  Then  x\y  G  Pf. 


Proof.  For  convenience,  let  z  =  x\y.  First  we  show  z(V )  =  f(V).  We  have 

z(V)  =  x{E)  +  y{A) 

=  f{E)  +  fv/E(A)  (37) 

=  f(E)  +  f(EuA)-f(E) 

=  f(V), 
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as  desired.  Now  let  0  B  C  V. 

z(B )  =  x(B  D  E)  +  y(B  D  A) 

<  f(BnE)  +  fv/E(BnA) 

=  f(B  nE)  +  m(B  n  A,  E) 

<  f(B  nE)+  m(B  nA,BOE)  (38) 

=  f(B),  (39) 

where  (38)  follows  from  submodularity  of  /,  and  (39)  follows  from  the  definition  of  marginal 
value.  □ 

Corollary  24  The  greedy  vector  b x  e  Pf. 

□ 

The  vector  that  is  1  in  component  v  and  zero  elsewhere  is  denoted  \v  The  dimension  of  \v 
should  always  be  clear  from  the  context. 

Theorem  25  Assume  a  normalized  submodular  function  f  on  V,  and  0  ^  A  C  V .  Then 
A  is  pseudoprime  with  respect  to  f  if  and  only  if  the  vector  f(A)xv  £  Pfv\(V-A)’  for  every 
v  e  A. 

Proof.  (=>)  Assume  0  ^  A  is  pseudoprime  with  respect  to  /.  Let  v  e  A,  and  let 
0  /  B  C  A.  If  v  e  B,  then 

f(A)Xv(B)  =  f(A)  <  f  (B), 

since  A  is  a  self  minimizer,  as  desired.  If  B  —  A,  then  equality  holds,  as  required.  Assume 
v  fL  B.  Then 

f{A)Xv{B)  =  0  <  f(B), 
since  A  is  pseudoprime,  as  desired.  □ 

(<*=)  Assume  f(A)xv  G  Pf,  f°r  every  v  G  A.  To  show  A  is  pseudoprime,  let  0  B  C  A. 
Let  v  G  A  —  B.  Since  f(A)xv  £  Pf,  we  have 

0  =  f(A)Xv(B)  <  f(B ), 

as  desired.  We  also  have 

f(A)  =  f(A)Xv(A-B)<f(A*B), 

which  gives  us 

m(B,A-B)  =  f(A)-f(A-B)<  0, 

as  desired.  □ 

Theorem  26  Let  {Ai,  S2, . . . ,  Sp,  T\ ,  T2l . . . ,  Tq}  be  a  pseudoprime  decomposition  ofV.  Then 
there  exists  a  collection  W  =  {(Aj,  -<*,  bl)  :  i  —  1, . . . ,  k}  of  weighted  extreme  vectors,  where 
for  each  i  =  1, . . . ,  k,  6*  is  the  greedy  vector  corresponding  to  -q  and  A*  >  0;  Y^=\  K  =  1; 
and  vector  x  :=  J2i=i  A ibl,  such  that: 
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1.  xv  <  0,  for  each  v  G  Si  U  •  •  •  U  Sp; 

2.  xv  >  0,  for  each  v  G  Tf  U  •  •  •  U  Tq); 

3.  for  each  j  G  {1, . . . ,  p},  the  set  (Si,-]  is  a  lower  ideal  of  each  order  TjG  W; 

4 ■  |{v  e  Sj  :  xv  ^  0}|  <  1,  for  each  j  G  {1, . . .  ,p}; 

5.  for  each  j  G  {1, . . . ,  p},  the  set  (Tf]  is  a  lower  ideal  of  each  order  TjG  W; 

6.  |{v  G  Tj  :  xv  ^  0}|  >  1,  for  each  j  G  {1, . . .  ,q}. 

Proof.  This  is  straightforward  from  Theorem  25  and  Proposition  23.  □ 

Next  we  show  how  to  find  a  psendoprime  decomposition,  together  with  the  collection  W 
of  weighted  extreme  vectors  guaranteed  by  Theorem  26.  Our  approach  involves  modifying 
Schrijver’s  algorithm  for  sub  modular  function  minimization,  which  we  review  next. 

6.1  Schrijver’s  Algorithm 

Here  we  review  Schrijver’s  polynomial  algorithm  for  minimizing  a  submodular  function. 
Given  a  collection  {-<i,  -<2,  •  •  • ,  -<k}  of  total  orders  on  V,  the  digraph  G  =  (V,  A)  has  an  arc 
(u,  v)  G  A  if  u-<iV,  for  some  i  G  {1, . . . ,  k}.  Given  total  order  -<  and  elements  s-<t  G  V,  the 
interval  (s,t]^  :=  {u  G  V  :  s-<u  T  t}. 

Input:  A  submodular  function  /  :  2V  — >  K,  having  /(0)  =  0,  given  via  an  oracle. 

Output:  1.  A  collection  of  weighted  extreme  points: 

W  =  {(Ai,  Ai,  b^1),  (A2,  -<2,  b<2), . . . ,  (A k,  - <k ,  where  E,=i  K  =  1, 

and  for  each  i  G  {1, . . . ,  k},  X i  >  0,  -<i  is  a  total  order  of  V,  and  b ^  is 
the  vector  obtained  via  the  greedy  algorithm  and  order  -<t. 

2.  A  set  U*  C  V  that  is  a  lower  ideal  of  each  order  -<i,  -<2, . . . ,  and 
such  that,  where  x  :=  Ef=i  XtIA\  the  set  U*  contains  every  element 
v  G  V  with  xv  <  0  and  U*  contains  no  element  v  G  V  with  xv  >  0. 

Step  0:  [Initialize] 

Let  -<i  be  an  arbitrary  order  of  V,  let  b^1  be  the  corresponding  extreme 
point,  and  let  Ai  =  1.  Put  W  :=  {(Ai, -<i,  Index  the  elements  of 

V  =  {1,2,  ...,n}. 

Step  1:  [Construct  Auxiliary  Digraph  with  Distances] 

Create  auxiliary  directed  graph  G  =  (V,  A),  where 
A  \=  {(«,  v)  :  u  -<i  v,  for  some  i  —  1, . . . ,  n}.  Define  x  :=  Ei=i  Aj6x<. 

Define  P  {v  G  V  :  xv  >  0},  and  N  {v  G  V  :  xv  <  0}. 

For  each  v  G  V,  define  dv  to  be  the  number  of  arcs  in  a  shortest  dipath  to 
v  from  some  node  in  P. 

Step  2:  [Check  Optimality  Condition] 

If  dv  =  Too,  for  each  v  G  N,  then  let 

U*  {v  G  V  :  there  is  a  dipath  from  v  to  some  node  in  A^}. 

Return  W  and  U* . 
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Step  3:  [Choose  s,  t,  and  -<i] 

Choose  t  G  N  with  dt  maximum  among  v  G  V  with  finite  dv,  breaking  any 
ties  by  choosing  t  with  maximum  index.  Choose  s  G  V  such  that  (s,  t)  G  A, 
ds  =  dt  —  1,  and  s  having  maximum  index.  Choose  order  -R  (renumbering 
if  necessary)  with  s  -<i  t  and  with  the  largest  |(s,f]^J. 

Step  4:  [Improve] 

Compute  6  >  0  such  that  b^1  +  S(xt  —  ys)  is  a  convex  combination  of  the 
extreme  points  IP'1’  ,  for  u  G  (s,  t] . 

Compute  y  =  x  +  Ai<5(x*  —  ys). 

Let  x’  be  the  point  on  the  line  segment  xy  closest  to  y  and  having  x\  <  0. 
Describe  x’  as  a  convex  combination  of  b for  *  =  1, ,  k,  and  6  A’  ,  for 
u  G  (s,  where  either  x't  =  0  or  b^1  is  removed  from  the  list.  Update  W. 

Step  5:  [Reduce  W] 

Apply  Gaussian  elimination  to  reduce  the  set  W  of  weighted  extreme  points 
to  one  having  size  at  most  |V|.  Return  to  Step  1. 


6.2  Correctness  and  Complexity  of  Schrijver’s  Algorithm 


Schrijver  shows  the  number  of  iterations  is  bounded  by  |U|6  as  follows.  In  the  current 
iteration,  let 

OL  .  |  (<S,  | , 


and  let 


/ 3  :=  number  of  i  G  {1, . . . ,  k}  with  |(s,  t}^  =  a. 


Let  x' ,  d',  A',  P',  N',  t\  s',  a',  f3'  be  the  objects  x,  d,  A,  P,  N,  t,  s,  a,  /3  in  the  next  iteration. 

For  each  iteration  of  the  algorithm  d'v  >  dv,  for  each  v  G  V.  (This  relies  on  the  fact  that 
P'  C  P  and  that  the  only  arcs  in  A'  \  A  are  of  the  type  (u,v),  where  s  Ai  v  -<i  u  Ai  t.) 
Moreover,  if  after  some  iteration,  d'v  =  dv,  for  each  v  G  V,  then  the  vector  ( d't ,,  t',  s',  a',  /3')  is 
lexicographically  smaller  than  ( dt ,  t,  s,  a,  (3).  While  dv  remains  constant,  for  each  v  G  V,  there 
are  at  most  \V\  different  possible  values  for  s,  a ,  and  /3,  and  at  most  \V\  different  possible 
pairs  ( dt,t ).  Thus,  there  are  at  most  |U|4  iterations  between  two  consecutive  iterations  in 
which  some  dv  increases.  Finally,  there  can  be  at  most  |D|2  iterations  in  which  some  dv 
increases. 


Given  that  the  algorithm  terminates,  it  must  do  so  in  Step  2.  At  that  point,  since  U*  has  no 
incoming  arcs  in  G ,  it  follows  that  U*  is  a  lower  ideal  in  each  -Q,  %  G  {1, . . . ,  k}.  Moreover, 
U*  contains  every  member  of  N  and  no  member  of  P.  It  now  follows  that  for  every  S  C  V, 


f(U *)  =  x{U*) 

<  x(S) 

<  ns), 


(40) 

(41) 

(42) 


where  (40)  follows  from  the  fact  that  U*  is  a  lower  ideal  of  -<;,  for  each  i  G  {1, . . . ,  k };  (41) 
follows  since  U*  contains  every  negative  component  and  no  positive  component  of  x;  and  (42) 
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follows  because  x  G  Pf.  This  proves  optimality  of  U*  and  completes  the  proof  of  correctness. 
□ 


6.3  Strong  Components  of  G 

In  this  section,  we  show  that  Schrijver’s  algorithm  can  be  modified  to  construct  a  pseu¬ 
doprime  decomposition  of  V,  together  with  the  collection  W  and  vector  x  guaranteed  by 
Theorem  26.  Our  analysis  shows  the  complexity  of  this  modified  algorithm  is  0(\U*\8). 

First  we  have  some  definitions  about  digraphs. 

Given  a  digraph  G  =  (V,A),  and  U  C  V,  let  G[U]  :=  ( U,A ')  be  the  subgraph  of  G  induced 
by  U,  where  arc  (u,  v )  G  A!  if  and  only  if  u  £  U,  v  £  U,  and  (u,  v)  G  A. 

Digraph  G  is  strongly  connected  if  for  every  pair  of  nodes  u,v  G  V,  G  has  a  dipath  from  u 
to  v. 

For  every  digraph  G  there  is  a  unique  partition  of  V  into  a  sequence  {V\,  V2, . . . ,  Vr},  where 
for  each  i  G  {1, . . . ,  r}, 

•  Gj  :=  G\Vi]  is  strongly  connected;  and 

•  any  arc  (u,v)  with  u  G  Vi  has  v  G  Vj,  for  some  j  >  i. 

The  digraphs  Gi  are  called  the  strong  components  of  G. 

During  execution,  Schrijver’s  algorithm  constructs  and  maintains  an  auxiliary  digraph.  Let 
G  =  (V,  A)  be  this  digraph  at  the  time  the  algorithm  terminates.  Let  us  also  have  the 
final  subsets  U*,  P,  and  N  of  V,  the  final  vector  x,  together  with  the  collection  of  weighted 
extreme  points: 


II  —  { (Ai,  -<1,  b^1),  (A2,  -<2,  b^2), . . . ,  (A*,,  -<k,  b^k)} 

where  Ya=\  A*  =  1,  and  for  each  i  G  {1, . . . ,  k},  A*  >  0,  -<*  is  a  total  order  of  V,  and  b^i  is 
the  vector  obtained  via  the  greedy  algorithm  and  order 

We  add  a  post-processing  phase  to  Schrijver’s  algorithm,  the  purpose  of  which  is  to  reach 
the  stage  where  each  strong  component  of  G[U*]  has  at  most  one  node  v  for  which  xv  7^  0. 
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Strong  Components  Algorithm 

Input:  A  submodular  function  /  :  2V  — >  3?,  having  /(0)  =  0,  given  via  an  oracle; 
the  ontpnt  from  Schrijver’s  Algorithm  applied  to  /. 

Output:  1.  A  collection  of  weighted  extreme  points: 

W  =  {(Ai,  -Ci,  b^1),  (A2,  -<2,  b<2), . . . ,  (A*,  -C k,  where  E,=i  A*  =  1, 

and  for  each  i  G  {1, . . . ,  k},  A i  >  0,  -q  is  a  total  order  of  R,  and  b is 
the  vector  obtained  via  the  greedy  algorithm  and  order  -<t. 

2.  Sets  Si,  S2,  ■  ■  ■ ,  S'p,  such  that: 

(a)  each  set  Si  is  a  strong  component  of  G ; 

(b)  each  set  .S)  U  . . .  U  St  is  a  lower  ideal  of  each  -C^; 

(c)  for  each  set  Si,  the  vector  x  has  at  most  one  nonzero  component 
and  that  component  is  xv  <0. 

Step  0:  [Initialize] 

Delete  V  —  U*  from  G  and  from  each  member  of  W. 

Let  Si,  S2,  ■  ■  ■ ,  Sp  be  a  sequenced  partition  of  U*  into  the  node  sets  of  the 
strong  components  of  G,  ordered  so  that  each  set  (Si]  is  a  lower  ideal  of 
each  order  in  W.  Index  the  members  of  U*  consistent  with  the  sequence 
Si,S2,...,Sp. 

For  each  i  G  {1 . .  .p},  choose  one  root  node  rq  G  Si. 

For  each  i  G  {1 . .  .p}  let  Gi  =  (Si,  A, )  be  G  restricted  to  node  set  Si. 

Step  1:  [Compute  Distances] 

For  each  i  e  define  du  to  be  the  number  of  arcs  in  a  shortest 

dipath  to  u  from  node  ut .  If  some  node  u  G  Si  is  not  reachable  from  Ui, 
then  subdivide  S,:  into  its  sequenced  partition  of  strong  components,  and 
choose  a  root  for  each  component  that  does  not  contain  the  current  iq. 
Renumber  the  sets  S,  to  reflect  this  subdivision. 

Step  2:  [Check  Doneness] 

If  xu  =  0,  for  each  u  G  Si  —  Ui,  and  each  i  G  {1 . . .  p},  and  if  every  ele¬ 
ment  v  G  V  has  at  some  point  been  a  designated  Ui,  then  stop  and  return 
Si,  S'2 , . . . ,  Sp.  If  xu  =  0,  for  each  u  G  S*  —  Ui,  and  each  i  G  {1 . . .  p},  but 
some  v  G  V  has  not  been  a  designated  iq  for  the  strong  component  to  which 
it  currently  belongs,  then  choose  such  a  v  E  Si,  say,  and  designate  v  as  u*. 

Step  3:  [Choose  s,  t,  in  St  and  -<i] 

Choose  a  component  G*  =  (Si,  A j)  with  some  nonzero  component  other  than 
xUi.  Choose  t  G  Si  —  Ui  with  xt  <  0  and  dt  maximum  among  v  G  St  —  Ui 
with  Xt  <  0,  breaking  any  ties  by  choosing  t  with  maximum  index.  Choose 
s  G  Si  such  that  (s,t)  G  Ai}  ds  =  dt  —  1,  and  s  having  maximum  index. 
Choose  order  -R  (renumbering  if  necessary)  with  s  -<1  t  and  with  the  largest 

KMUI- 

Step  4:  [Improve  with  s  and  t  in  5)] 

Compute  6  >  0  such  that  b^1  +  5(xt  —  Xs)  is  a  convex  combination  of  the 
extreme  points  b^1  ,  for  uG 
Compute  y  =  x  +  Ai<5(yt  —  ys). 
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Let  x'  be  the  point  on  the  line  segment  xy  closest  to  y  and  having  x\  <  0. 
Describe  x'  as  a  convex  combination  of  for  i  —  1, . . . ,  k,  and  &A’  5  for 
u  G  (s,  where  either  x\  =  0  or  b<x  is  removed  from  the  list.  Update  W. 

Step  5:  [Reduce  W] 

Apply  Gaussian  elimination  to  reduce  the  set  W  of  weighted  extreme  points 
to  one  having  size  at  most  \U*\.  Return  to  Step  1. 


6.4  Correctness  and  Complexity  of  Strong  Components  Algorithm 


We  show  the  number  of  iterations  dealing  with  is  bounded  by  \U*\‘  as  follows.  In  the 
current  iteration,  let 

OL  .  |  (<S,  | , 


and  let 


/ 3  :=  number  of  i  G  {1, . . . ,  k}  with  (s,  t]^  =  a. 


Let  x',  d',  A',  P N',  t' ,  s',  a' ,  (3 '  be  the  objects  x,  d,,  A,  P,  N,  t,  s,  a,  (3  in  the  next  iteration. 

A  subdivision  may  occur  at  most  | U*\  times.  Between  2  iterations  involving  a  subdivision, 
an  iteration  involving  a  reassignment  of  some  Ui  may  occur  at  most  \U*\  times.  Now  let 
us  develop  an  upper  bound  on  the  number  of  iterations  between  2  consecutive  iterations 
starting  with  a  subdivision  or  a  reassignment. 

For  each  iteration  that  does  not  start  with  a  subdivision  or  reassignment,  \U*\  >  d'v  >  dv, 
for  each  v  G  U*.  Thus,  there  can  be  at  most  \U*\2  iterations  in  which  some  dv  increases, 
between  2  consecutive  iterations  having  subdivisions  or  reassignment. 


Now  let  us  develop  an  upper  bound  on  the  number  of  consecutive  iterations  in  which  d 
remains  constant. 


First  we  argue  that  (d't,,t' ,  s' ,  a' ,  /3')  is  lexicographically  smaller  than  (dt,  t,  s,  a,  (3).  Assume 
d!v  =  dv  for  every  v  G  U* .  If  d’f  <  dt ,  then  we  are  done.  If  not,  then  by  choice  of  t,  d[,  =  dt.  If 
t  7^  t',  then  t  <  t',  by  choice  of  t.  Assume  t  =  t' .  Then  x't  <  0,  which  means  b<l  was  removed 
from  W .  If  s'  7^  s,  then  s'  <  s,  and  we  are  done.  Otherwise,  we  have  s'  =  s  and  t'  =  t. 
Any  orders  introduced  in  the  iteration  have  |(s,  t]|  <  a.  Therefore,  since  -fo  was  chosen  with 
greatest  |(s,  £]|,  it  must  be  that  a'  <  a.  If  a'  =  a ,  then  since  -<i  has  been  removed,  we  can 
conclude  that  (3'  <  (3.  This  completes  the  lexicographic  argument. 

There  are  at  most  \U*\  different  possible  values  for  (3,  a,  and  s.  While  d  remains  constant, 
there  are  at  most  \U*\  different  pairs  ( dt,t ).  Thus,  there  are  at  most  15^1 4  iterations  between 
two  consecutive  iterations  in  which  some  dv  increases. 

Together  with  the  fact  that  there  can  be  at  most  \U*\2  iterations  in  which  some  dv  increases, 
between  2  consecutive  iterations  with  subdivision  or  reassignment,  and  the  fact  that  there 
are  an  most  \U*\2  iterations  with  subdivision  or  reassignment,  gives  the  bound  of  at  most 
2 1 1/*  | 8  iterations. 

Given  that  the  algorithm  terminates,  it  must  do  so  in  Step  2.  At  that  point,  the  sequence 
Si, ...  ,SP  has  the  required  properties.  □ 
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The  strong  components  algorithm  works  only  with  the  minimize!'  U*,  and  returns  the  de¬ 
composition  {Si, . . . ,  Sk}  of  U*.  It  may  be  applied  to  V  —  U*  and  /  to  obtain  {Ti, . . . ,  TJ }. 

6.5  Extreme  point  solution 

Consider  the  following  primal-dual  pair  of  linear  programming  problems: 


Maximize 

x(V) 

Subject  to: 

x(A)  <  f(A ), 

for  each  ACV 

Xy  <  0, 

for  each  v  G  V 

Minimize 

Y  f{A)  VA 

A<XV 

Subject  to: 

Va  <  1, 

ACV  :  VGA 

for  each  v  G  V 

IV 

0 

for  each  AC  V 

Let  x  and  U*  be  the  vector  and  minimizing  set  obtained  by  executing  Schrijver’s  algorithm. 
Let  x  be  the  vector  obtained  from  x  by  replacing  each  component  xv  with  min(xv,  0).  Let 
ye  R2  be  the  vector  that  is  1  on  U*  and  0  elsewhere. 

It  is  known  and  not  difficult  to  show  (by  showing  that  they  are  feasible  and  complementary) 
that  x  and  y  are  optimal  solutions  to  P  and  D,  respectively.  Indeed,  this  is  the  proof  of 
optimality  of  U*. 

We  know  for  linear  programming  theory  that  every  linear  programming  problem  that  has  an 
optimal  solution  has  an  extreme-point  optimal  solution.  One  might  ask  for  an  extreme-point 
optimal  solution  to  P.  We  have  the  following. 


Theorem  27  Let  x  be  the  vector  obtained  by  executing  Schrijver’s  algorithm  followed  by 
the  Strong  Components  algorithm.  Let  x  be  the  vector  obtained  from  x  by  replacing  each 
component  xv  with  min(xv,  0).  Then  x  is  an  extreme-point  optimal  solution  to  P. 

Proof.  We  already  know  that  x  is  an  optimal  solution  to  P.  To  show  that  x  is  an  extreme 
point,  it  suffices  to  provide  an  ordering  -<  of  V  so  that  for  each  v  G  V,  we  have  either 
that  xv  =  0  or  x([i;)x)  =  f([v)^).  Let  {Si,  S2, . . . ,  Sk}  be  the  pseudo-prime  decomposition 
obtained  after  execution  of  Schrijver’s  algorithm  and  the  Strong  Components  algorithm,  and 
let  Ui  be  the  last  designated  root  for  5),  for  each  i  G  { 1,2,...,  k}.  Take  ordering  -<  to  start 
with  the  elements  Si  U  •  •  •  U  Sk,  be  compatible  with  the  sequence  {Si,  S2, . . . ,  Sk},  and  have 
Ui  last  within  St,  for  each  i  G  {1,  2, . . . ,  k}.  The  elements  of  V  —  (Si  U  •  •  •  U  Sk)  come  later,  in 
any  order.  It  is  easy  to  check,  using  the  fact  that  xUi  =  fv/[Si)(Si),  for  each  i  G  { 1,2,...,  k}, 
that  this  ordering  -<  satisfies  the  required  conditions.  □ 


7  Conclusions 

We  conclude  with  some  questions. 
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Is  there  a  way  to  strengthen  Theorem  21  or  Theorem  17  to  conclude  that  A  is  prime  pseu¬ 
doprime? 

Investigate  further  the  structure  of  strong  components  of  final  digraph  G  of  the  Strong 
Components  algorithm.  These  correspond  to  the  sets  in  a  pseudo-prime  decomposition. 
Let’s  take  the  first  one,  G\  =  (Si,  Af).  For  each  choice  of  u\  G  Si  the  algorithm  gives  a  G\. 
There  are  possibly  many  different  graphs  G\  the  algorithm  could  give  for  each  u \ ,  and  also 
possibly  many  different  still  for  different  choices  of  u \ .  Can  we  say  anything  about  these 
digraphs?  For  example,  is  there  one  digraph  that  “works”  for  all  choices  of  U\! 

Can  the  complexity  bound  obtained  here  for  the  Strong  Components  algorithm  be  improved? 
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